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Abstract 

This paper considers the appUcation of integral Linear Quadratic Gaussian (LQG) optimal con- 
trol theory to a problem of cavity locking in quantum optics. The cavity locking problem involves 
controlling the error between the laser frequency and the resonant frequency of the cavity. A model 
for the cavity system, which comprises a piezo-electric actuator and an optical cavity is experi- 
mentally determined using a subspace identification method. An LQG controller which includes 
integral action is synthesized to stabilize the frequency of the cavity to the laser frequency and to 
reject low frequency noise. The controller is successfully implemented in the laboratory using a 
dSpace DSP board. 
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I. INTRODUCTION 



Many future technologies will be based on quantum systems manipulated to achieve 
engineering outcomes Quantum feedback control forms one of the key design 

methodologies that will be required to achieve these quantum engineering objectives 

Examples of quantum systems in which quantum control may 
play a key role include the quantum error correction problem (see ll|) which is central to 
the development of a quantum computer and also important in the problem of developing 
a repeater for quantum cryptography systems, spin control in coherent magnetometry (see 
[121), control of an atom trapped in a cavity (see 18|), the control of a laser optical quantum 
!;le. (see b,), con.., of a.cn lase. Bee Einstein Condensates (see Q), and the 



feedback cooling of a nano mechanical resonator (see |15l|). 

Attention is now turning to more general aspects of quantum control, particularly in the 
development of systematic quantum control theories for quantum systems. For example 
and [l^ it was shown that the linear quadratic Gaussian (LQG) optimal control 



m 

approach to controller design can be extended to linear quantum systems. Also, in 



m it 



was shown that the H°° optimal control approach to controller design can be extended to 
linear quantum systems. These theoretical results indicate that systematic optimal control 
methods of modern control theory have the potential of being applied to quantum systems. 
Such modern control theory methods have the advantage that they are strongly model 
based and provide systematic methods of designing multivariable control systems which can 
achieve excellent closed loop performance and robustness. Experimental demonstrations of 
some of these theoretical results now appear viable. For example, Ref. presents the first 
experimental demonstration of the design and implementation of a "coherent controller" 
from within this formalism. 

One particular systematic approach to control is the LQG optimal control approach to 
design. LQG optimal control is based on a linear dynamical model of the plant being con- 
trolled which is subject to Gaussian white noise disturbances; e.g, see 19|. In LQG optimal 
control, a dynamic linear output feedback controller is sought to minimize a quadratic cost 
functional which encapsulates the performance requirements of the control system. A fea- 
ture of the LQG optimal control problem is that its solution involves the use of a Kalman 
Filter which provides estimates of the internal system variables. Furthermore, in many ap- 
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plications integral action is required in order to overcome low frequency disturbances acting 
on the system being controlled. This issue is addressed here by using a version of LQG 
optimal control referred to as integral LQG control which forces the controller to include 
integral action; see 2^. 

In this paper, we consider the application of systematic methods of LQG optimal control 
to the archetypal quantum optical problem of locking the resonant frequency of an opti- 
cal cavity to that of a laser. Homodyne detection of the reflected port of a Fabry-Perot 
cavity is used as the measurement signal for an integral LQG controller. In our case, the 
linear dynamic model used is obtained using both physical considerations and experimen- 
tally measured frequency response data which is fitted to a linear dynamic model using 
subspace system identification methods; e.g., see |21|]. The integral LQG controller design 
is discretized and implemented on a dSpace digital signal processing (DSP) system in the 
laboratory and experimental results were obtained showing that the controller has been ef- 
fective in locking the optical cavity to the laser frequency. We also compare the step response 
obtained experimentally with the step response predicted using the identified model. 

This paper is structured as follows: In Section [Til the quantum optical model of an empty 
cavity is formulated in a manner consistent with the LQG design methodology; Section IIIII 
outlines the subspace system identification technique used to arrive at the linear dynamic 
model for the cavity system; Section [TVl presents the LQG optimal controller design method- 
ology as applied to the problem of locking the frequencies of a laser and of an empty cavity 
together; Section |V] presents experimental results; and we conclude in Section |Vll 

II. CAVITY MODEL 

A schematic of the frequency stabilization system is depicted in Fig. [H 



The cavity can be described in the Heisenberg picture 
differential equations; e.g., see [22] and Section 9.2.4 of 



by: 



the following quantum stochastic 



23|: 



a = -(- + iA)a - v^o(/3 + 60) 

bout = v^o« + P + bo. (1) 
Here, the annihilation operator for the cavity mode is denoted by a and the annihilation 
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FIG. 1: Cavity locking feedback control loop. 



operator for the coherent input mode is denoted hj b = /3+bo, both defined in an appropriate 
rotating reference frame. Here 60 is quantum noise. We have written k = kq + ni + k^, 
where kq, ki and kl quantify the strength of the couplings of the respective optical fields 
to the cavity, including the losses. The input to the cavity is taken to be a coherent state 
with amplitude (3 and which is assumed to be real without loss of generality. A denotes the 
frequency detuning between the laser frequency and the resonant frequency of the cavity. 
The objective of the frequency stabilization scheme is to maintain A = 0. The detuning is 
given by [2^ 

A = Uc- ujl = q-^ - ujl, (2) 

where Uc is the resonant frequency of the cavity, ujl is the laser frequency, nL is the optical 
path length of the cavity, c is the speed of light in a vacuum and g is a large integer indicating 
that the q^^ longitudinal cavity mode is being excited. 

The cavity locking problem is formally a nonlinear control problem since the equations 
governing the cavity dynamics in ([1]) contain the nonlinear product term A a. In order 
to apply linear optimal control techniques, we linearize these equations about the zero- 
detuning point. Let a denote the steady state average of a when A = such that a = a + d. 
The perturbation operator a satisfies the linear quantum stochastic differential equation 
(neglecting higher order terms) 

a = --^a - iAa - 0«o^o - v^i&i - V^l^l- (3) 
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The perturbed output field operator bout is given by 

bout = v^o« + ^0 (4) 

which implies bout = v^o*^ + P + bout- 

We model the measurement of the quadrature of bout with homodyne detection by 
changing the coupling operator for the laser mode to ^/K,Qe'^'^a, and measuring the real 
quadrature of the resulting field. The measurement signal is then given by 

y = bout + bit = v^o(e-''^S + e'^~a^) + qo (5) 

where qo = bo + fej is the intensity noise of the input coherent state. 

As we shall see in Section HVt the LQG controller design process starts from a state-space 
model of the plant, actuator and measurement, traditionally expressed in the form: 



X = Ax + Bu + DiW] 

y = CX + D2W (6) 

where x represents the vector of system variables (we shall not use the control engineering 
term "states" to avoid confusion with quantum mechanical states), u is the input to the 
system, y is the measured output, and w is a Gaussian white noise disturbance acting on 
the system. Also, A represents the system matrix, B is the input matrix, C is the output 
matrix, and Di and D2 are the system noise matrices. 

The cavity dynamics and homodyne measurement are expressed in state-space form in 
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terms of the quadratures of the operators a, 60, ^i, as 
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(7) 



with noise quadratures qj = bj + fo], pj = —i{qj —p\), for j = 0, 1, L (all standard Gaussian 
white noises). Here, y is the homodyne detector output in which we have included an 
electronic noise term W2- Also, k2 represents the transimpedance gain of the homodyne 
detector, including the photodetector quantum efficiency. 



III. SUBSPACE SYSTEM IDENTIFICATION 

The state-space model of the cavity given in ([7]) is incomplete as it does not include an 
explicit model, including the actuation mechanism, for the dynamics of the detuning, A. 
The dynamics of the detuning and actuation mechanism are sufficiently complex that direct 
measurement is a more experimentally reasonable approach than a priori modeling of the 
system. Following these measurements, an approach called subspace system identification 
is used to obtain the complete state-space model. 

It is at this point that the controller design process diverges from traditional, pre-1960s 
control techniques. Specifically, in the traditional approach, a controller is designed using 

6 



root-locus or frequency response methods, based on measurements of the plant transfer func- 
tion [25]. In our modern control approach, the subspace identification method determines a 
state-space model from the input-output frequency response data and generates the system 
matrices A, B and C in ([H]); see j26|. The system matrices are used in the LQG design 
process as we shall see in Section IIVI 

The transfer function of the cavity and measurement system (or alternatively the "plant" ) 
is identified under closed-loop conditions. We use an analog proportional-integral (PI) con- 
troller to stabilize the system for the duration of the measurement. The frequency response 
data thus obtained for the plant is plotted in Fig. [21 From the data, at least three reso- 
nances can be clearly identified, occurring at frequencies of about 520, 2100 and 5000 Hz 
respectively. 





Freq(Hz) 



FIG. 2: Measured plant frequency response. 

An S^'^-order anti-aliasing filter with a corner frequency of 2.5 kHz (chosen because it 
is far greater than the unity-gain bandwidth of the controller and far less than the 50 
kHz sampling frequency) was placed immediately prior to the digital LQG controller. This 
is treated mathematically as augmenting the plant such that the augmented plant has a 
frequency response that is the product of the plant data gathered previously and the anti- 
aliasing filter which is identified separately. 

The frequency response data obtained is then fitted to a 13**^ order model using a subspace 



identification method; see 



2l| . The algorithm accommodates arbitrary frequency spacing 
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and is known to provide good results with flexible structures. This makes it suitable for 
our application which includes a piezo-electric actuator coupled to the cavity mirror. Fig. [3] 
compares the gain (in dB) and the phase (in deg) of the measured frequency data for the 
augmented plant with that of its identifled system model. 




10* 10^ 

Freq(Hz) 



FIG. 3: Measured frequency response data for the augmented plant and frequency response for the 
identified system model. 



IV. LINEAR QUADRATIC GAUSSIAN OPTIMAL CONTROL 



The LQG optimal control approach to controller design begins with a linear state-space 
model of the form Note that this model involves the use of Gaussian white noise 

disturbances although a more rigorous formulation of the LQG optimal control problem 
involves the use of a Wiener process to describe the noise rather than the white noise model 
IQ; e.g., see [27|. However, for the purposes of this paper, a model of the form ([6]) is 
most convenient. In the model ([6]), the term Diw corresponds to the process noise and 
the term D2W corresponds to the measurement noise. The LQG optimal control problem 
involves constructing a dynamic measurement feedback controller to minimize a quadratic 
cost functional of the form 



J 



lim E 

T^oo 



1 f 

— / [x'^Qx + Ru]dt 
T Jo 



(8) 
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where Q > and i? > are symmetric weighting matrices. The term x^Qx in the cost 
functional ([8]) corresponds to a requirement to minimize the system variables of interest and 
the term vF Ru corresponds to a requirement to minimize the size of the control inputs. 
The matrices Q and R are chosen so that the cost functional reflects the desired perfor- 
mance objectives of the control system. The great advantage of the LQG optimal control 
approach to controller design is that it provides a tractable systematic way to construct 
output feedback controllers (even in the case of multi-input multi-output control systems). 
Also, numerical solutions exist in terms of algebraic Riccati equations which can be solved 
using standard software packages such as Matlab; e.g., see [19|, l28[. A feature of the solution 
to the LQG optimal control problem is that it involves a Kalman filter which provides an 
optimal estimate x of the vector of system variables x based on the measured output y. This 
is combined with a "state-feedback" optimal control law which is obtained by minimizing 
the cost functional ([8]) as if the vector of system variables x was available to the controller. 

Note that the LQG controller design methodology cannot directly handle some impor- 
tant engineering issues in control system design such as robustness margins and controller 
bandwidth. These issues can however be taken into account in the controller design process 
by adding extra noise terms to the plant model (over and above the noise that is present in 
the physical system) and by suitably choosing the quadratic cost functional ([8]). 

A. LQG Performance Criterion and Integral Action 



The dynamics of the cavity and measurement system can be subdivided as shown in 
Fig. m and comprises an electro- mechanical subsystem and an electro-optical subsystem (the 
optical cavity and homodyne detector). 
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FIG. 4: Block diagram of the plant. 
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The control objective is to minimize the cavity detuning A, which is not available for 
measurement. Instead, the measurement signal y is the output of the homodyne detector 
and to include A in the performance criterion, we need to relate A to 2;, the mean value 
of y. It can be seen from ([7]) that the transfer function of the optical cavity from A to z 
is a first-order low-pass filter with a corner frequency of /t/2. Physically, this arises from 
the well-known (see for example 
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291] and the references therein) transfer function of the 



optical cavity from A to a phase shift, which is then measured by the homodyne detector. In 
the experimental system described herein k/2 ^ 10^ Hz, which is well beyond the frequency 
range of interest for the integral LQG controller. Hence we can consider z to be proportional 
to A under these conditions, and therefore minimizing variations in A can be regarded as 
being equivalent to minimizing variations in z. 

The LQG performance criterion to be used for our problem is chosen to reflect the desired 
control system performance. That is, (i) to keep the cavity detuning A small (ideally zero), 
and (ii) to limit the control energy. However, these requirements are not sufficient to generate 
a suitable controller as the system is subject to a large initial DC offset and slowly varying 
disturbances. Our application requires the elimination of such effects. This can be achieved 
by using integral action and is the reason for our use of the integral LQG controller design 
method. 

We include integral action by adding an additional term in the cost function which in- 
volves the integral of the quantity z. Moreover, we include the "integral state" as another 
variable of the system. The new variable J z dt is also fed to the Kalman filter, which when 
combined with an optimal state-feedback control law leads to an integral LQG optimal con- 
troller. This controller will then meet the desired performance requirements as described 
above; e.g., see [20]. 

Fig. [5] shows the integral LQG controller design configuration. 

The overall system can be described in state-space form as follows: 

Ax + Bwi + Bu; 
W2 
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Cx + 



W3 



(9) 



where 
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FIG. 5: Integral LQG controller design configuration 



Here the matrices A, B, C are constructed from the matrices A, 5, C as follows: 





A 




B 




C 


A = 


C 


, B = 





, and C = 


I 



Section [XTTl outlines the technique used to determine A, B, C . 

In equation ([9]), the quantity Wi represents mechanical noise entering the system which 
is assumed to be Gaussian white noise with variance e\. The quantity W2 represents the 
sensor noise present in the system output which is assumed to be Gaussian white noise 
with variance e^. The quantity W3 is included to represent the sensor noise added to the 
quantity j z dt. This is assumed to be Gaussian white noise with variance e| and is included 
to fit into the standard framework for the LQG controller design. The parameters ei, €2 and 
€3 are treated as design parameters in the LQG controller design in Sec. IIVBI 

The integral LQG performance criterion can be written as: 



J 



hm E 



[x^Qx + L{zYQL{z) + u^Ru]dt 



(10) 



where 



Liz) 



z(t) dr. 



We choose the matrices Q, R and Q such that 

x'^Qx 



u^Ru 



r\u\ 



and Q = q, 



where r > and g > are also treated as design parameters. 

The first term of the integrand in (fTO!) ensures that the controlled variable z goes to 
zero, while the second term forces the integral of the controlled variable to go to zero. Also, 
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the third term serves to hmit the control input magnitude. The expectation in (fTO!) is with 
respect to the classical Gaussian noise processes described previously, and the assumed Gaus- 
sian initial conditions. Given our system as described by the optimal LQG controller is 
given by (e.g., see [lol ) 



u 



where X is the solution of the following matrix Riccati equation 

= XA + A^X + Q - r-^XB'^BX, 



(11) 



(12) 



and 



1 
q 



C. 



Here x is an optimal estimate of the vector of plant variables x obtained via a steady state 
Kalman filter which can be described by the state equations 



X = Ax + Bu + K[y - Cx\. 



(13) 



For the case of uncorrelated process and measurement noises, the steady state Kalman filter 
is obtained by choosing the gain matrix K in (fT3|) as 



K = PC^V^\ 

where P is the solution of the matrix Riccati equation 



Here 



= iP + PA^ + Vi- PC^Vo'^CP. 



el 



(14) 



(15) 



Vi = elBB^ = E[wiwf] and V2 -- 
define the covariance of the process and measurement noises respectively. 



el 



B. Design Parameters 



In designing the LQG controller, the parameters (the mechanical noise variance), €3 
(the sensor noise variance of y), e| (the variance of the sensor noise added to J z), r (the 
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control energy weighting in the LQG cost function) and q (the integral output weighting in 
the LQG cost function) were used as design parameters and were adjusted for good controller 
performance. This includes a requirement that the control system have suitable gain and 
phase margins and a reasonable controller bandwidth. The specific values used for the design 
are shown in Table [B 



Design parameter 


Value 


ei 


5 X lO-'^ 




500 




3 X 10-* 


r 


1 X 10' 


q 


1 X 10** 



TABLE I: Design Parameter Values 



These parameter values led to a 15*'^ order LQG controller which is reduced to a 6**^ order 
controller using a frequency-weighted balanced controller reduction approach. We reduce 
the order of the controller to decrease the computational burden (and hence time-delay) 
of the controller when it is discretized and implemented on a digital computer. The new 
lower order model for the controller is determined via a certain controller reduction tech- 
nique which minimizes the weighted frequency response error between the original controller 
transfer function and the reduced controller transfer function; see [s^. This is illustrated in 
Fig. [6] which shows Bode plots of the full-order controller and the reduced order controller. 
Formally, the reduced order controller is constructed so that the quantity 

P{s)C{s) 



.(Cis)-Cris)) 



(16) 



{I + P{s)C{s)) 

is minimized. Here, P{s) = C{sl — A)^^B, is the plant transfer function matrix and 
C{s) = F{sl — A + KC — BF)~^K is the original full controller transfer function matrix. 
Also, Cr{s) is the reduced dimension controller transfer function matrix. The notation 
||M(s)||oo refers to the H°° norm of a transfer function matrix M{s) which is defined to be 
the maximum of amax[M{iuj)] over all frequencies a; > 0. Here amax[M{iuj)] refers to the 
maximum singular value of the matrix M{iuj). 
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Note that this approach to controller reduction does not guarantee the stability of the 
closed loop system with the reduced controller. We check for closed loop stability stability 
separately after the controller reduction process. 




10"' 10° 10' 10^ 10^ 10" lo'^ 




10"' 10° 10' 10^ 10' 10* lo'^ 
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FIG. 6: Full and reduced-order continuous LQG controller Bode plots. 

The reduced controller is then discretized at a sampling rate of 50 kHz and the cor- 
responding Bode plot of the discrete-time loop gain is shown in Fig. [71 This discretized 
controller provides good gain and phase margins of 16.2 dB and 63° respectively. 




-1500 - 



10' lo'^ 10^ 

Freq (Hz) 



FIG. 7: Bode plot of loop gain L. The controller provides a gain margin of 16 dB and 63° phase 



margin. 
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V. EXPERIMENTAL RESULTS 



The discrete controller is implemented on a dSpace DS1103 Power PC DSP Board. This 
board is fully programmable from a Simulink block diagram and possesses 16-bit resolution. 
The controller successfully stabihzes the frequency in the optical cavity, locking its resonance 
to that of the laser frequency, /o; see 3l|. This can be seen from the experimentally 
measured step response shown in Fig. [8] This step response was measured by applying a step 
disturbance of magnitude 0.1 V to the closed- loop system as shown in Figure [H Here r is 
the step input signal and y is the resulting step response signal which was measured. 
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FIG. 8: Step Response of the closed-loop system to an input of 0.1 V. 




FIG. 9: Setup used to measure the closed-loop step response 
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VI. CONCLUSION AND FUTURE WORK 



In this paper, we have shown that a systematic modern control technique such as LQG 
integral control can be applied to a problem in experimental quantum optics which has 
previously been addressed using traditional approaches to controller design. From frequency 
response data gathered, we have successfully modeled the optical cavity system, and used 
an extended version of the LQG cost functional to formulate the specific requirements of 
the control problem. A controller was obtained and implemented which locks the resonant 
frequency of the cavity to that of the laser frequency. 

To improve on the current system, one might consider using additional actuators such as 
a phase modulator situated within the cavity or an additional piezo actuator to control the 
driving laser. Additional sensors which could be considered include using a beam splitter and 
another homodyne detector to measure the other optical quadrature and an accelerometer 
or a capacitive sensor to provide additional measurements of the mechanical subsystem. 
In addition, it may be useful to control the effects of air turbulence within the cavity and 
an additional interferometric sensor could be included to measure the optical path length 
adjacent to the cavity. Such a measurement would be correlated to the air turbulence 
effects within the cavity. All of these additional actuators and sensors could be expected to 
improve the control system performance provided they were appropriately exploited using 
a systematic multivariable control system design methodology such as LQG control. 

One important advantage of the LQG technique is that it can be extended in a straight- 
forward way to multivariable control systems with multiple sensors and actuators. Moreover, 
the subspace approach to identification used to determine the plant is particularly suited to 
multivariable systems. It is our intention to further the current work by controlling the laser 
pump power using a similar scheme as the one used in this paper. This work is expected to 
pave the way for extremely stable lasers with fluctuations approaching the quantum noise 
limit and which could be potentially used in a wide range of applications in high precision 
metrology, see [32 1. 
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